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We  study  precise  conditions  under  which  the  cyclic  regenerative 
confidence  intervals  of  Sargent  and  Shantihikumar  are  asymptotically  valid. 

We  also  obtain  an  optimal  way  of  implementing  the  cyclic  regenerative  variance 
reduction  technique,  and  obtain  a  sufficient  condition  under  which  the 
procedure  yields  a  lower  variance  than  that  of  the  standard  regenerative 
method. 
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SIGNIFICANCE  AND  EXPLANATION 


Simulation  is  a  commonly  used  method  of  analysis  for  studying  complex 
stochastic  systems*  Often,  the  parameter  of  interest  to  the  simulator  can  be 
estimated  by  more  than  one  quantity*  When  more  than  one  estimator  exists,  it 
is  desirable  to  use  the  more  stable  estimate,  namely  the  one  with  the  lesser 
variance* 

tL  ,  < 

In  this  paper,  ye  consider  a  class  of  stochastic  processes  which  enjoy 
cyclic  regenerative  structure  -  such  systems  often  arise,  for  example,  in 
analysis  of  queues*  W*~ study  a  family  of  estimators  recently  Introduced  by 

Sargent  and  Shantihikumar  and  determine  precise  conditions  under  which  the 

‘  /•  ■  * 

estimators  are  asymptotically  valid,  we  also  obtain  a  closed-form  solution 
for  the  minimum  variance  estimate  in  the  family,  and  prove  that  this  estimator 
will  often  be  superior  to  the  standard  regenerative  estimator  for  the 
simulation* 
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ON  CONFIDENCE  INTERVALS  FOR  CYCLIC  REGENERATIVE  PROCESSES 


Pater  W.  Glynn 


1 •  Introduction 

Recently,  Sargent  and  Shantihikumar  [5]  developed  an  interesting  new 
variance  reduction  technique  designed  to  exploit  the  stochastic  structure 
associated  with  a  cyclic  regenerative  process*  Our  purpose  here  is  to  study 
precise  conditions  under  which  the  confidence  intervals  proposed  in  [5]  are 
asymptotically  valid*  This  analysis  will  provide  us  with  the  side  benefit  of 
obtaining  an  optimal  way  of  implementing  the  variance  reduction  procedures 
introduced  there.  To  be  precise,  we  will  obtain  the  minimum  variance  estimate 
in  the  class  of  estimates  proposed  in  [5].  We  will  also  determine  conditions 
under  which  the  minimum  variance  estimate  achieves  a  lower  variance  than  that 
of  the  standard  regenerative  method  (see  Crane  and  Lemoine  [4]  for  a 
description  of  the  standard  procedure)* 

We  will  use  the  convention  that  assumptions  in  force  throughout  the 
entire  paper  will  be  prefixed  by  A  (eg.  A1 )  whereas  all  others  will  be 
prefixed  by  B*  We  can  now  state  our  basic  assumptions  for  the  problem: 

A1 •  {X^  ;  n  >  0}  is  a  regenerative  process  with  regenerative  times 

0  -  T0  <  T.  <  ...  satisfying  ET,  <  •,  where  x  «  T  -  T 

u  1  1  n  n  n-1 

A2.  f  is  a  real-valued  function  such  that  EY  (|f|)  *  E{|f(X^  )| 

n  T 

n-1 


+  ...+  |f(XT  H)|}  <  •. 


A3.  Th«r«  exist  random  tines  {a  .  1  n  >  0,  0  <  i  <  t}  such  that 

nf  l 


n-1 


o  .  <  cl  .  <...<  a 
n,0  n,  1  n,t 


T  and  Cor  which  {(Y  ,  ,T  . )  » 

n  n, i  n,i 


n  >  1}  ar*  independent  and  identically  distributed  (i.i.d.)  random 
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vectors  (r.v. '•)  for  1  <  1  <  t,  where  t 


n,i 


a  .  -  a  .  .  end 
n,i  n#i-1 


an#i-1  n#i 


Assunptiona  A1  end  A3  basically  define  the  notion  of  e  t-phaee  cyclic 
regenerative  process*  We  will  also  suppose  that  the  s inula tor  possesses  the 
following  knowledge: 

A4*  BY*  |,  BT  are  known  for  i  «  D. 
w*  1 « i 

A5*  The  sinulator  can  sanple  independently  fren  each  of  the  distributions 
(y11,  t1  A),  i  «  P  -  {1,...,t)\D. 

n 

Under  A1  and  A2,  £  f(X  )/n  ♦  r  ■  BY1(f)/BT  a.s.  (see  [4]  for  a  proof). 

k-0  * 


The  goal  of  the  sinulator  is  to  obtain  confidence  intervale  for  r 


2.  A  Central  Limit  Theorem 

Xn  the  setting  of  a  cyclic  regenerative  process,  tha  practitioner  mist 

decide  on  a  saapling  order  before  initiating  tha  simulation.  To  be  precise, 

the  simulator  must  assign,  for  each  n  >  1,  an  integer  mR  from 

G  ■  F  V)  {0}.  The  practitioner  then  simulates  the  sequence  of  independent 

r.v. 's  {(W  ,x  )  i  n  >  1),  where  (W_  ,x_)  is  sampled  from  the  distribution 
n  n  n  n 

of  (Yj  ,1^  J  if  €  F  and  from  that  of  if  ■*  0 

'*n  **n 

(independent  sailing  is  possible  on  account  of  A5).  Put  «  .  ■ 

{J  <  n  i  *  1}  and  let  be  the  cardinality  of  «n  ^  for  i  e  G.  The 

natural  point  estimate  for  r  is  given  by 

rn  "  (  l  *n  i  ♦  l  K,  «>/<  I  \  ,  +  1  ET1 

i«G  ,X  iCD  1,1  i«G  fi  i«D  1#i 


where  Y 


n,i 


}  WJA«,i'  Tn,l  "  XjAn,i 


e  The  a.s.  convergence 


n,  i 


j€« 


n#i 


of  r  to  r  ie  ensured  by* 


A6*  either  i. )  k  .  ♦  •  if  i  e  F,  k  A  =  0  or  ii.)  k  .  ♦  •  if  i  e  G. 
nffi  n,0  n,i 

To  obtain  a  confidence  interval  for  r#  we  need  a  central  limit  theorem  (CLT) 
-  such  behaviour  is  guaranteed  by: 

Bl.  0  <  of  &  o2(Y,  4  -  rx.  .)  <  •  for  i  «  F, 

X  1 #1  l/i 

0  <  o2  •  C^Y^ff)  -  rT^)  <  •. 

Theorem  It  Under  Bl,  there  exist  constants  aR  such  that 

a  (r  -  r)  ■»>  11(0,1),  where  11(0,1)  is  a  unit  normal  r.v. 
n  n 

Proof i  We  shall  prove  the  result  under  A6  i. ) ,  the  proof  under  A6  ii.)  being 
similar.  We  view  the  problsm  in  terms  of  a  triangular  array  of  r.v.'s  by 


setting 


and  observe  that 


if  »4  - 


Vj  ‘  (*j  ’  "j  *  *i,/k.,i 

i,  «h.r.  -  rlt  -  tot  0„  -  I  0B  j 


*«  6  ^<V  ■  .1  °X,i 


iff 


Then,  the  triangular  array  {U  ./a  }  satisfies  Lindeberg's  condition  sines 

n#3  n 


for  any  e  >  0, 


2  -.2  v  2  2* 
» *  •„> 


l,  ■to.,l'V  Vi 
« ,L  zni  *  *2|t..i^>  * 0 

ler 

as  n  ♦  •»  here  zi#^  “  Y^  ^  -  rt^  ^  +  0^  (in  the  inequality,  we  used 
2  2 

*n  *  °jAn  •  Since  EUn,j  *  0,  it  follows  by  Lindeberg's  theorem  (see 
Chung  [3],  p.  205)  that  Un/sn  — >  N(0,1).  Hence, 

(  I  Y  ~  r r  +  0.  )/s  —  >  N(0,1)  . 

tW  n,t  n#i  1 


But  I  04  ■  I  EY,  .  -  rET  .  Thus,  using  the  fact  that 
i«F  1  i«D  #i  1,1 

t  ■  J  t  .  +  J  et.  .  ♦  Etb  a.s.  and  the  converging'-together  leans 

n  ier  n,i  i€D  1,1  1 

(Billingsley  [2],  p.25)  proves  that 

a^r,^  -  r)  »->  H(0,1) 

where  *  -  Et f/s.  II 
n  in 

In  a  simulation  application,  one  needs  to  estimate  the  constants  an« 
For  the  estimation;  we  need  to  add  an  additional  hypothesis: 


b2.  e(y^a  +  t*  )  <  •  for  i  e  p,  E(y^(f)  ♦  t*)  < 

Notice  that  if  Y^A  •  rt^  i  +  ®i  where  ET*  A  ■  •  and  0  <  E0*  <  •,  then 
Bl  is  satisfied  but  not  B2. 
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Corollary  1 »  Under  B1-B2,  there  exist  estimates  a^  such  that 

a(r  -  r)  «■>  11(0,1). 
n  n 

Proof  i  By  the  converging  together  lesnaa,  this  follows  from  Theorem  1  if  we 

A  A 

obtain  estimates  a  such  that  a  /a  ♦  1  a.s.  Under  A6  i.)  an  appropriate 
n  n  n 

A  A  A  Aj  A  ^ 

candidate  for  a  is  t  /s  where  s  ■  )  o  .A  .  and 

n  n  n  n  *  n,i  n#i 


-  I  (w.  -  r  XJ,)2A  .  -  (  £  w  -  r  X  A 

'A  ««  3  n  J  3  n  j  n. 


jeu 


n,i 


jew 


n#i 


But  |1-  a2/a2 |  <  T  |1  -  E2t.  o2  ./T2  c^|  ♦  0  a.s*  A  similar  proof  works  under 
n  n  j  nfi  n  l 


ieF 


A6  ii.)  || 


The  CLT  of  Corollary  1  can  be  used  to  construct  confidence  intervals 
for  r.  The  half-width  of  a  100(1-6)%  confidence  interval  for  r,  based  on 

A 

a  sample  of  size  n,  will  be  zx/a  #  where  z*  solves 

on  o 

P{N( 0, 1 )  <  Zfi}  -  1  -  i/2. 


-5 


To  analyse  the  degree  of  variance  reduction  of  a  Method,  one  needs  to 
compare  the  half-width  of  competing  intervals  generated  in  a  given  aaount  of 


s isolation  tine.  In  our  context,  this  is  accosiplished  by  constructing 


intervals  based  on  (»1  ,x^ ) , 


'<Wi(N)'Xi(H)>'  wh*r*  *<*>  • 


nax{k  t  *1  ♦...♦  x^  <  n}. 

To  base  a  CUT  on  a  random  number  i(N)  of  independent  r.v. 's  requires 
control  on  the  growth  of  the  ^^'11 

B3.  if  ♦  •»  then  kR  ^/n  ♦  c^.  If  c^,  Cj  are  both  sero,  then 

kn,)A».l  *  Ylj  »  °* 

TheoreM  2t  Under  B1  and  B3,  at(u)^r£(H)  “  r)  m“>  *(##1)  where  the  an's 

are  the  constants  of  Theorem  1. 

Proof  1  He  assume  we  are  dealing  with  A6  i.) ,  the  proof  for  A6  ii.)  being 
similar.  Suppose  then  that  is  minimal  for  i  »  s*  Then,  by  B1  and  B3, 

(3.1) 


k1/2(Z  .  1  i  «  P)  — >  N 

n,s  n,i 


where  H  is  a  Multivariate  normal  r.v.  with  (possibly)  singular  components 


(Z, 


n,i 


I  Z  .A  . )  -  in  fact,  it  is  easy 
n,3  n,i 


to  obtain  a  weak  invariance 


n,i 


principle  version  of  (3.1) 

Put  8n  ■  Xj  +...+  Xjj  and  observe  that 

S_/n  -  l  l  x  /n 
1CT  JWn,i  ^ 

■  l  (  l  *.»A  .)  •  k 

i«p  je«  .  3  n'A  n'J 

n#i 

♦  l  ci  4  «••• 
i«P  1  1,1 


/n 


*“•  *«  ‘ <  <w, 


SO 


st(N,/t(N)  <  H/t(W)  <  St(N)+1/t(H) 

and  thus,  by  'aqoMzing'  N/£(N),  we  obtain  the  result  that 

H/i (H )  ♦  T  c.  ET,  a.s.  Then,  using  the  weak  invariance  version  of  (3.1) 
i#r  1  #1 

and  the  random  time  change  results  of  [2],  p.  146,  we  have  that 

j,  5»«),i/a  _>  "<0',) 


vh ere  o  m  \  ca°^ci  cg  -  cA  »  0,  set  c^/c^  *  Yig>« 

iep 

application  of  the  converging  together  lemma  shows  that 

i«(N),r»(H)  *  r>  “> 


Another 


2  2  2 

where  a  »  k  E  x4/o  •  But  B3  guarantees  that  a  /a  ♦  1,  yielding  the 
n  n,s  1  "  n  n 

theorem*  1 1 

Again,  in  terms  of  the  confidence  interval  problem,  one  needs  to  estimate 
ai(N)4  T^e  following  corollary  follows  immediately  from  Theorem  2,  and  the 

A 

fwct  that  a  /a  ♦  1  a«s* 
n  n 

A  A 

Corollary  2t  Under  B1-B3,  ajKn)^r£(n)  ~  ”>  where  the  *nf8  are 

the  estimators  of  Corollary  1. 

Finally,  we  can  often  re-write  the  CLT  of  Theorem  2  in  another  form« 

If  c  is  positive,  then  k  /nc  ♦  1,  so  that  we  obtain  the  following 
s  n ,  s  s 

result* 


Corollary  3>  Assume  B3  holds  with  all  c^s  positive.  The,  under  Bl,  there 

exists  O  such  that  ^^r^j-rj/o  «•>  N(0,1).  Also,  under  B1-B2,  there 

exist  estimators  0^  such  that  “*>  N(0, !)• 

—2  —2 

Proof i  The  result  is  obvious,  upon  identifying  a  ,  cQ.  Under  A6  i.), 

*  -  (oWx,)  .  (  I 

CiBT1,i//C»)  and  “ 


Intervals 


4.  Optimal  Confidence 

We  now  wish  to  lnvesti9ate  the  amount  of  variance  reduction  over  the 
standard  regenerative  method  that  is  accomplished  by  using  the  intervals 
proposed  in  Section  3*  Let  v(N)#  v(c,N)  be  the  half-widths  of  100(1-4)% 
confidence  intervals  based  on  simulating  N  time  units  and  using  the  standard 
regenerative  interval  and  the  interval  of  Corollary  2,  respectively  (we  write 
v(c,N)  to  reflect  dependence  on  c  *  (c^))«  The  following  result  may  be 
found  in  [4]* 

Lemma  1 1  Under  B1-B2,  N^vtW)  z&o/lEr^)^2  &  z^a  a*s. 

In  view  of  Lemma  1,  the  next  lemma  shows  that  it  is  never  optimal  to 

allow  to  tend  to  •  in  such  a  way  that  kn^/n  *► 

Lemma  2:  Suppose  B1-B3  hold  and  k  ♦  ®  with  c_  *  0.  Then 
"  n  t  b  s 

1  /2  ♦ 

N  v(N,c)  -►  •  a.s. 

*2 

Proof  i  The  assertion  is  equivalent  to  proving  that  N/a^^j  ♦  But 


A 

N/a 


2 

t(H) 


A2  /2 

“  "  8A(N)/TJl(N) 

>  N°»(N),8/kt(N),s 


A2 

Tt(N) 


-  «/»<»»  •  II 


Thus,  in  our  search  for  optimal  intervals,  we  need  only  consider  the  case 
where  all  c^' s  are  positive.  This  allows  Corollary  3  to  be  applied  to 
obtain  a  second  cyclic  regenerative  interval  with  half-length  <(N,c) 

(say).  The  following  result  follows  from  the  proofs  of  Theorem  2  and 
Corollary  3. 

Lemma  3i  Suppose  B1-B3  hold  with  all  c^'s  positive.  Then, 
v(N,c)/k(N,c)  ♦  1  a.s.  Furthermore,  under  A6  i.), 

N1/2v(H,c)  ♦  z  .(  J  02/c  ) 1/>2 (  l  c  BT  V^/ET,  a.s. 

6  ier  1  1  ier  1  1fi  1 

-8- 


and  under  A6  ii.) 


N1/ZV(N,C)  ♦  Z.(02/C  +  l  °i/ci)1/2(c0ET1  +  1  ciETi  i)1/Z/^2ETl  a*8, 

ter  ieF  ' 

We  are  now  in  a  position  to  determine  the  optimal  constants  c. 

2  1  /2  2 

Theorem  3*  Assume  B1-B2  hold*  If  a  <(  S  o.( ET.  .)  )  ,  then  no 

■  .  i  i/i 

ie? 

variance  reduction  is  possible  via  the  cyclic  intervals  of  Section  3. 

Otherwise/  the  maximal  reduction  is  obtained  via  the  cyclic  interval  of 

Section  3  in  which  k  ./n  +  c.  for  i  €  F,  where 

n,i  *4 


k1/2 


gi  -  a  oi/(ET11) 


1/2 


(4.1) 


1/2. ”1 


1  I  > 

i€F 


The  percentage  variance  reduction  achieved  is  then 

100(1  -  l  o.(BT.  ,)1/2/0)2)%. 
ieF  1  #i 

Proof :  By  Lemma  3,  it  is  clear  that  the  optimal  interval  possible  via  a 

cyclic  method  of  type  A6  i*)  is  obtained  by  choosing  k  ./n  ♦  c.  for  i  €  F, 

n  /  i 

where  c^  solves  the  optimization  problem 

minimize  (  J  o2/ct)(  l  ciET1 
ieF  i6F  ' 

subject  to  \  c  »  1 ,  c  >  0  . 

ieF  1  1 


(4.2) 


Application  of  the  method  of  Lagrange  multipliers  to  this  problem  (see  Avriel 

[1],  p.  48)  show  that  a  minimal  c  must  satisfy 

.2.  r  __  .  .2 


(4.3) 


'  V  I  *  ETi,i<  I  W  *  x 

ieF  9  ieF 


for  each  i  6  F  and  some  constant  X.  Multiplying  the  i*th  equation  of  (4*3) 
by  c^  and  adding  all  the  resulting  equations  proves  that  X  *  0*  Equation 
(4.3)  shows  that 

2  2 
c  »  n  ff  /Er 

i-i  M  i'  l ,  i 


9- 


1 


It 


for  momm  ?)•  The  proportionality  factor  n  ia  determined  by  J  c.  - 

iCP 

is  easily  checked  that  c,  as  given,  is  the  minimum  desired,  with  minimal 
value 

o2  -  (  l  a  (EX  )1/2)2/e2x  . 

i«F  1  1,1  1 

A  similar  analysis  for  cyclic  intervals  of  type  A6  ii.)  shows  that  the  minimal 
possible  value  for  the  analog  of  (4«2)  is  given  by 

(0(B  ry)U2  +  l  0i(KT1#1)1/2)2/4E2T1 


-  (o/2  +  o/2) 2  >  min(o2,02) 

which  shows  that  intervals  of  type  A6  11.)  can  never  achieve  lower  asymptotic 
half-width  than  the  better  of  the  standard  or  cyclic  (of  type  A6  i.)) 
regenerative  intervals*  The  other  assertions  of  the  theorem  are  trivial*  | | 
This  theorem  suggests  that  the  practitioner  should  execute  a  small  "pilot 
run"  to  obtain  approximate  values  for  c^*  If  the  "pilot  run"  suggests  a 
variance  reduction  over  the  standard  method,  the  simulator  should  construct  a 
sampling  order  which  ensures  that  k^  ^/n  ♦  c^  for  i  e  F,  and  then  employ 
the  cyclic  regenerative  method. 

We  conclude  with  a  sufficient  condition  that  guarantees  that  the  cyclic 

regenerative  method  achieves  a  variance  reduction  over  the  standard  procedure* 

2  ~2 

Lemma  4:  If  B1-B3  holds#  then  a  <  a  if 

cov(Y  .  -  rx  ,  Y  -  rx  )  >  0  for  1  <  i,  j  <  t. 

1,1  1,1  •  9  J  IfJ 

2 

Proof t  Since  a  is  minimal  for  (4*2), 


22  <  <  l  «i)(I  ®x  ±)/s2x 

i€F  ' 


iep 


<  <  U)/E ti  <  a2<  l  Y  -  rt  )/ETl  < 

iep  iep 


-2 

a 


-10- 


.  ^ 


the  last  two  inequalities  by  the  covariance  condition* 
He  caution  that  o2  >  a2  is  possible  if  the 
negatively  correlated. 


-11- 
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